Papers with coreference resolution
Copied to clipboard
| Challenge: | Mention detection is an important preprocessing step for downstream applications such as NER and coreference resolution. |
| Approach: | They propose and compare three approaches to mention detection using ELMO embeddings and a biaffine classifier. |
| Outcome: | The proposed model outperforms state-of-the-art models on the GENIA corpora and improves on mention recall. |
Copied to clipboard
| Challenge: | Unlike singular mentions each of which represents one entity, plural mentions stand for multiple entities. |
| Approach: | They propose a novel coreference resolution algorithm that selectively creates clusters to handle both singular and plural mentions and a deep learning-based entity linking model that jointly handles both types of mentions through multi-task learning. |
| Outcome: | The proposed model outperforms existing models designed for singular mentions and plural mentions. |
Copied to clipboard
| Challenge: | Existing literature on relation classification models shows no consensus on optimal architecture . |
| Approach: | They propose a search space for BERT based relation classification models and employ an ENAS method to find better architectures. |
| Outcome: | The proposed method can find better architectures than baseline models on eight benchmark RC tasks. |
Copied to clipboard
| Challenge: | Entity coreference resolution aims to identify mentions that refer to the same entity. |
| Approach: | They propose a triad-based neural network system that generates affinity scores between entity mentions for coreference resolution. |
| Outcome: | The proposed system generates affinity scores between mentions for coreference resolution. |
Copied to clipboard
| Challenge: | Tutorial examines the role of Wikipedia in tasks related to text analysis and retrieval. |
| Approach: | tutorial examines the role of Wikipedia in tasks related to text analysis and retrieval. |
| Outcome: | This tutorial examines the role of Wikipedia in tasks related to text analysis and retrieval. |
Copied to clipboard
| Challenge: | Using OntoNotes, coreference resolution systems are typically evaluated on this data exclusively. |
| Approach: | They present a new dataset of coreference annotations for works of literature in English covering 29,103 mentions in 210,532 tokens from 100 works of fiction published between 1719 and 1922. |
| Outcome: | The proposed dataset covers 29,103 mentions in 210,532 tokens from 100 works of fiction published between 1719 and 1922. |
Copied to clipboard
| Challenge: | Many natural language processing tasks can be formulated as deep reinforcement learning (DRL) problems. |
| Approach: | This tutorial provides an introduction to the foundations of deep reinforcement learning . it describes recent advances in designing deep reinforcement for NLP . |
| Outcome: | This tutorial provides an introduction to the foundations of deep reinforcement learning and some practical solutions for NLP tasks. |
Copied to clipboard
| Challenge: | Annotators are asked to annotate coreferent spans of text, which is unnatural . we present an alternative in which annotators can preprocess documents and assign pronouns to entities. |
| Approach: | They propose an alternative in which annotators are asked to assign pronouns to entities and preprocess documents to create a knowledge base. |
| Outcome: | The proposed model-based approach leads to faster annotation and higher inter-annotator agreement and opens up an alternative approach to coreference resolution. |
Copied to clipboard
| Challenge: | a novel approach to predicting source-and-target factuality is presented . our linearized tree generation task fully accounts for the factuity tree structure . |
| Approach: | They propose a linearized tree generation task which fully accounts for factuality . they then create a system which leverages the linearized representation to create visualizations . |
| Outcome: | The proposed model and representation fully account for the factuality tree structure, generating the full chain of nested sources instead of the last source only. |
Copied to clipboard
| Challenge: | In French, most coreference resolution systems run different setups, making comparisons difficult. |
| Approach: | They present a full-stack model that outperforms other approaches for coreference resolution in French . they compare it with the first end-to-end neural French coreference model trained on democrat . |
| Outcome: | The proposed model outperforms the current systems for spoken and written French. |
Copied to clipboard
| Challenge: | limited research and datasets pose significant challenges in Thai language . a proposed model capable of simultaneously handling CR and ZPR tasks takes less time to train . |
| Approach: | They propose to annotate a Thai-based CR and ZPR dataset and introduce a model that can handle both tasks by adjusting the span definition to include token gaps. |
| Outcome: | The proposed model outperforms the state-of-the-art in resolving both coreference resolution and zero-pronoun resolution while taking less time to train. |
Copied to clipboard
| Challenge: | a new dataset, MuDoCo, is composed of authored dialogs between a fictional user and a system . the dialogs cross domains and users exhibit complex task switching behavior . |
| Approach: | They propose a new dataset, MuDoCo, composed of authored dialogs between a fictional user and a system . they propose two baseline models for the downstream tasks: coreference resolution and referring expression generation. |
| Outcome: | The proposed dataset contains 8,429 dialogs with an average of 5.36 turns per dialog . the users exhibit complex task switching behavior such as re-initiating a previous task . |
Copied to clipboard
| Challenge: | Existing tools that support only a few major languages are under-optimized for accuracy due to a focus on efficiency or use of less powerful models. |
| Approach: | They introduce a Python natural language processing toolkit that supports 66 languages . they train Stanza on 112 datasets and show it generalizes well on all languages compared to other tools . |
| Outcome: | The proposed toolkit performs well on 112 datasets and is compatible with the popular Java CoreNLP software. |
Copied to clipboard
| Challenge: | Existing methods for coreference resolution are based on word2vec-like representations of entities. |
| Approach: | They propose a large-scale English dataset for coreference resolution . they use 38K documents and 12.5M words from English-speaking preschoolers . |
| Outcome: | The proposed dataset is more efficient with higher training-test overlap than OntoNotes . the study also shows that mention detection and clustering are more efficient on PreCo . |
Copied to clipboard
| Challenge: | We present a new information extraction system that can construct temporal event graphs from news documents. |
| Approach: | They propose a temporal event graph extraction system that can extract news documents . they extend the system from sentence-level event extraction to cross-document cross-media event extraction . |
| Outcome: | The proposed system can extract temporal event graphs from news documents in multiple languages and multiple data modalities. |
Copied to clipboard
| Challenge: | Recent coreference resolvers have notable improvements on the CoNLL evaluation sets, but struggle to generalize properly to new datasets. |
| Approach: | They investigate the role of linguistic features in building more generalizable coreference resolvers . they show that employing features and subsets of their values that are informative for coreference resolution improves generalization . |
| Outcome: | The proposed system achieves state-of-the-art results on WikiCoref, compared with a system trained on CoNLL. |
Copied to clipboard
| Challenge: | Existing approaches to extract aspects from text are supervised and unsupervised . experimental results show that unsupervised approaches are more accurate than supervised ones . |
| Approach: | They propose to combine a lexical rule-based approach with coreference resolution to improve accuracy. |
| Outcome: | The proposed approach outperforms baseline methods on two benchmark datasets. |
Copied to clipboard
| Challenge: | LOME is a system for performing multilingual information extraction with large ontologies. |
| Approach: | They propose a system for multilingual information extraction with a framenet parser . LOME is available as a Docker container on Docker Hub and a lightweight version is available on the web . |
| Outcome: | The proposed system outperforms or is competitive with the (monolingual) state-of-the-art . it can be used to build knowledge graphs with large ontologies and across multiple languages . |
Copied to clipboard
| Challenge: | Existing datasets vary in definition of coreferences and are curated for linguistic experts. |
| Approach: | They propose to use ezCoref to create a crowdsourcing-friendly coreference annotation methodology that teaches annotators only cases that are treated similarly across existing datasets. |
| Outcome: | The proposed method reannotates 240 passages from seven existing english coreference datasets while teaching annotators only cases that are treated similarly across them. |
Copied to clipboard
| Challenge: | CRAFT corpus provides a unique foundation for integrating natural language processing (NLP) tasks involving structure, semantics, and coreference. |
| Approach: | They propose to use the CRAFT corpus to evaluate three fundamental language processing tasks over full-text biomedical articles. |
| Outcome: | The CRAFT corpus provides a unique foundation for integrating natural language processing tasks involving structure, semantics, and coreference. |
Copied to clipboard
| Challenge: | Using points of correspondence, fusion systems are difficult for abstractive summarizers because of their complexity. |
| Approach: | They propose to model points of correspondence between disparate sentences by combining documents, source and fusion sentences, and human annotations of points of correspondance between sentences. |
| Outcome: | The proposed model bridges the gap between coreference resolution and summarization by using human annotations of points of correspondence between sentences. |
Copied to clipboard
| Challenge: | Existing studies on information extraction from unstructured texts lack a coherent evaluation of all tasks. |
| Approach: | They propose to use crowdsourcing data to develop a Korean information extraction initiative point . they propose to train and evaluate four Korean information extracting tasks using a state-of-the-art model . |
| Outcome: | The proposed model will be used to evaluate four Korean information extraction tasks using crowdsourcing data. |
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) is a key framework in natural language processing . however, the effectiveness of RAG is often hindered by coreferential complexity in retrieved documents . |
| Approach: | They investigate how entity coreference affects document retrieval and generative performance in RAG-based systems. |
| Outcome: | The proposed model improves QA performance and retrieval relevance and contextual understanding. |
Copied to clipboard
| Challenge: | Existing systems for identifying spans as mentions are based on mention-pair formulations, but they are not generalized beyond pronouns. |
| Approach: | They propose a sentence-incremental neural coreference resolution system which incrementally builds clusters after marking mention boundaries in a shift-reduce method. |
| Outcome: | The proposed system outperforms state-of-the-art methods on OntoNotes and CODI-CRAC 2021 datasets and is comparable to state- of-the art methods. |
Copied to clipboard
| Challenge: | e-mail corpus for entity resolution in email conversations is first large scale annotated corpus . ecc is a two-step process with minimal manual effort. |
| Approach: | They present the first large scale corpus for entity resolution in email conversations . they use 6001 email threads and 38,996 entity coreference chains to construct the corpus . |
| Outcome: | The proposed corpus is the first large scale annotated corpus for entity resolution in email conversations. |
Copied to clipboard
| Challenge: | Existing models for online decoding on active input are not trained to handle an online decode environment. |
| Approach: | They propose a new direction of coreference resolution for online decoding on actively generated input such as dialogue . they propose to use models that accept utterances and their past context and find mentions upon each dialogue turn . |
| Outcome: | The proposed model outperforms the baseline model by 10% on three datasets: Friends, OntoNotes, and BOLT. |
Copied to clipboard
| Challenge: | Existing methods for debiasing word embeddings lack gender-based debiases . Existing approaches only reduce gender-related proximity biases by at least 42.02% . |
| Approach: | They propose a gender debiasing methodology that eliminates bias in word vectors and alters spatial distribution of neighboring vectors, achieving a bias-free setting while maintaining minimal semantic offset. |
| Outcome: | The proposed method outperforms the state-of-the-art in reducing proximity bias by at least 42.02% and reduces direct bias, adding minimal semantic disturbance, and achieves the best performance in a downstream application task. |
Copied to clipboard
| Challenge: | Existing knowledge extraction pipelines for English are not suitable for enterprise use. |
| Approach: | They propose a knowledge extraction pipeline for English which can be further used for building an entreprise-specific knowledge base. |
| Outcome: | The proposed pipeline can be used to build an entreprise-specific knowledge base. |
Copied to clipboard
| Challenge: | a new framework for structured prediction is developed for natural language processing . a systematic approach to structured prediction requires exhaustive pair-wise comparisons of tokens . |
| Approach: | They propose a method that models the relationship between pairs of tokens in a string . they use a parallel method that predicts real numbers for each token in . |
| Outcome: | The proposed method doubles the speed of graph-based dependency parsers and brings 10-times speed-up over graph-driven dependency parses. |
Copied to clipboard
| Challenge: | KWJA supports a wide range of tasks including typo correction, word segmentation, word normalization, named entity recognition, dependency parsing, PAS analysis, bridging reference resolution, coreference resolution, and discourse relation analysis. |
| Approach: | They propose to build a Japanese text analyzer based on foundation models that performs a wide range of tasks. |
| Outcome: | The proposed model performs better in a multi-task manner than other analyzers with specialized models. |
Copied to clipboard
| Challenge: | Existing methods for predicate argument structure analysis are difficult and difficult . a Japanese model can detect a zero pronoun and identify a referent of the zero pronominator . |
| Approach: | They propose a model that performs coreference resolution and predicate argument structure analysis simultaneously. |
| Outcome: | The proposed model can improve the performance of the inter-sentential zero anaphora resolution drastically. |
Copied to clipboard
| Challenge: | Existing deep neural networks for coreference resolution for Polish have been used to resolve textual fragments that refer to the same entity in the discourse world. |
| Approach: | They propose a system combining the best deep neural architecture and sieve-based coreference resolvers ordered from most to least precise to achieve the highest results. |
| Outcome: | The proposed system improves the state of the art for Polish by 0.53 F1 points, reaching 81.23 points of the CoNLL metric. |
Copied to clipboard
| Challenge: | Existing methods for quotation attribution in literary novels require varying levels of available information. |
| Approach: | They propose to train and evaluate models for character identification, coreference resolution, quotation identification and speaker attribution tasks using an annotated dataset. |
| Outcome: | The proposed model scores on speaker attribution task on the same scale as state-of-the-art models. |
Copied to clipboard
| Challenge: | Recent neural network models for coreference resolution are usually trained with heuristic loss functions that are computed over a sequence of local decisions. |
| Approach: | They propose an end-to-end reinforcement learning based coreference resolution model to directly optimize coreference evaluation metrics. |
| Outcome: | The proposed model achieves new state-of-the-art performance on the English OntoNotes v5.0 benchmark. |
Copied to clipboard
| Challenge: | Recent evaluations of LLMs on coreference resolution have revealed that traditional output formats and evaluation metrics do not fully capture the models’ referential understanding. |
| Approach: | They propose a benchmark for mention resolution presented in a multiple-choice question format and a curated mixture of different mention types and corresponding entities. |
| Outcome: | The proposed model achieves 81.9% accuracy while the open model achieve 80%. |
Copied to clipboard
| Challenge: | Existing approaches to coreference resolution capture the properties of entity clusters and use them in the resolution process. |
| Approach: | They propose an approach that captures entities and uses them in coreference resolution . they propose an "Entity Equalization" mechanism that represents each mention in a cluster . |
| Outcome: | The proposed approach improves the CoNLL-2012 coreference resolution task by 3.6%. |
Copied to clipboard
| Challenge: | Pretrained language models perform structural understanding tasks that focus on understanding one aspect of the text. |
| Approach: | They propose a method for improving the structural understanding abilities of language models by pretraining them to generate structures from the text on task-agnostic corpora. |
| Outcome: | The proposed model performs state-of-the-art on 21 of 28 datasets. |
Copied to clipboard
| Challenge: | Currently, end-to-end models learn coreference resolution implicitly by observing aligned sentences in bilingual corpora. |
| Approach: | They develop a method that derives coreference clusters from MT output and evaluates them without requiring annotations in the target language. |
| Outcome: | The proposed model outperforms existing models on three challenging benchmarks. |
Copied to clipboard
| Challenge: | Recent years have seen a paradigm shift in NLP towards using pretrained language models for a wide range of tasks. |
| Approach: | They propose to model structures as sequences of actions in autoregressive manner with PLMs . their approach allows in-structure dependencies to be learned without any loss . |
| Outcome: | The proposed approach achieves state-of-the-art on all structured prediction tasks. |
Copied to clipboard
| Challenge: | Existing methods for identifying markables for coreference annotation are task and language-independent and can be used for a variety of other annotation tasks. |
| Approach: | They propose a method for identifying markables for coreference annotation that combines automatic markable detectors with checking with a Game-With-A-Purpose (GWAP) and aggregation using a Bayesian annotation model. |
| Outcome: | The proposed method improves mention boundaries on news and other genres by over seven percentage points compared with state-of-the-art, domain-independent automatic mention detectors and almost three points over an in-domain mention detector. |
Copied to clipboard
| Challenge: | Several recent efforts have focused on benchmark datasets consisting of pairs of contrastive sentences, which are often accompanied by metrics that aggregate an NLP system’s behavior on these pairs into measurements of harms. |
| Approach: | They apply a measurement modeling lens to inventory pitfalls that threaten benchmarks' validity as measurement models for stereotyping. |
| Outcome: | The proposed benchmarks lack clarity and assumptions that affect how they conceptualize and operationalize stereotyping. |
Copied to clipboard
| Challenge: | a new context understanding benchmark is proposed for short-context understanding in Russian . the benchmarks focus on broad reasoning tasks or long-concept comprehension, but are limited in their ability to perceive subtle nuances of context. |
| Approach: | They propose a new benchmark for evaluating short-context understanding in Russian . they propose to use four tasks to assess model performance from a specific perspective . |
| Outcome: | The proposed benchmark is adapted to Russian-language data. |
Copied to clipboard
| Challenge: | Using Ontonotes, documents in certain genres were split into smaller parts for ease of annotation. |
| Approach: | They propose to merge annotations from documents split into smaller parts in Ontonotes for ease of annotation. |
| Outcome: | The proposed corpus restores documents to their original form, revealing dramatic increases in length in certain genres. |
Copied to clipboard
| Challenge: | a new approach to coreference resolution uses a span-ranking architecture as an attention mechanism to iteratively refine span representations. |
| Approach: | They propose a fully-differentiable approximation to higher-order inference for coreference resolution . they propose introducing a coarse-to-fine approach that incorporates a less accurate but more efficient bilinear factor . |
| Outcome: | The proposed model significantly improves accuracy on the English OntoNotes benchmark while being far more computationally efficient. |
Copied to clipboard
| Challenge: | Document-level event extraction aims to extract structured information from unstructured text. |
| Approach: | They propose a cross-document event extraction pipeline that integrates event information from multiple documents and provides a comprehensive perspective on events. |
| Outcome: | The proposed pipeline achieves about 72% F1 in end-to-end cross-document event extraction, setting up a benchmark for future research. |
Copied to clipboard
| Challenge: | Context Tracking is a computational task for human-human conversations . it involves identifying important entities and keeping track of their properties and relationships . |
| Approach: | They propose to use a human-human conversation corpus for context tracking with people and location annotations to model the conversation's context. |
| Outcome: | The proposed model is based on a large human-human conversation corpus with people and location annotations. |
Copied to clipboard
| Challenge: | Traditionally, corpora are limited to arguments within the same sentence, and inter-sentential arguments are more challenging and have received less attention. |
| Approach: | They propose a question-answering approach to extract document-level event-argument structures by automating questions for each argument type an event may have. |
| Outcome: | The proposed model outperforms previous models and is especially beneficial to extract arguments that appear in different sentences than the event trigger. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are a new approach to coreference resolution, but their performance is not yet fully understood. |
| Approach: | They propose that future efforts should improve scope, data, and evaluation methods of traditional coreference research to adapt to the development of LLMs. |
| Outcome: | The proposed methods improve scope, data, and evaluation methods of traditional coreference research to adapt to the development of LLMs. |
Copied to clipboard
| Challenge: | Using unsupervised entity linking, we solve named entity recognition, coreference resolution and relation extraction tasks together. |
| Approach: | They propose to use a knowledge base to inject information into a joint IE model by using unsupervised entity linking. |
| Outcome: | The proposed model improves on two datasets with 5% F1 score. |
Copied to clipboard
| Challenge: | a typical approach to natural language processing tasks involves selecting text spans and making decisions about them. |
| Approach: | They propose a grammar-based structured span selection model which learns to make use of partial span annotations. |
| Outcome: | The proposed model improves on two popular span prediction tasks. |
Copied to clipboard
| Challenge: | a meta-analysis and survey of practitioners reveal that benchmarks suffer from operationalization disagreements. |
| Approach: | They propose a taxonomy of disagreement to explain disagreements in NLP benchmarks . they propose defining how tasks are conceptualized and operationalizing benchmarks to document their limitations. |
| Outcome: | The proposed taxonomy identifies two types of disagreements among NLP practitioners . it shows that benchmarks are not clearly conceptualized and suffer from operationalization disagreements . |
Copied to clipboard
| Challenge: | Recent studies have found evidence of gender bias in machine translation and coreference resolution models using mostly synthetic diagnostic datasets. |
| Approach: | They propose a semi-automatic method to vastly extend synthetic, small diagnostic datasets to include grammatical patterns indicating stereotypical and non-stereotypical gender-role assignments. |
| Outcome: | The proposed method extends the existing dataset to 108K diverse English sentences. |
Copied to clipboard
| Challenge: | Existing models for coreference resolution are based on independent mention pair-wise decisions. |
| Approach: | They propose a model that learns coreference at the document-level and takes global decisions. |
| Outcome: | The proposed model improves over baselines, reinforcing the hypothesis that document-level information improves conference resolution. |
Copied to clipboard
| Challenge: | Using BiPaR, we build monolingual, multilingual and cross-lingual MRC on novels. |
| Approach: | They propose a bilingual parallel novel-style machine reading comprehension dataset BiPaR . they collect 3,667 bilingual parallel paragraphs from Chinese and English novels . |
| Outcome: | The proposed dataset supports multilingual and cross-lingual reading comprehension. |
Copied to clipboard
| Challenge: | Existing methods for joint entity relation extraction use multitask learning frameworks, but annotations for additional tasks are hard to obtain. |
| Approach: | They propose a pre-training method to improve the joint extraction performance with just extra entity annotations. |
| Outcome: | The proposed method outperforms existing methods on ACE05, SciERC, and NYT and outperformed BERT on other tasks. |
Copied to clipboard
| Challenge: | Existing methods for event coreference resolution use symbolic features, but they are noisy and contain errors. |
| Approach: | They propose a context-dependent gated module to adaptively control the information flows from the input symbolic features. |
| Outcome: | The proposed model achieves state-of-the-art on two datasets: ACE 2005 and KBP 2016 . |
Copied to clipboard
| Challenge: | Text segmentation is a long standing issue in the area of natural language processing . even modern methods struggle with processing text longer than a couple of sentences or paragraphs . |
| Approach: | They introduce the task of scene segmentation on narrative texts and provide an annotated corpus . they discuss linguistic and narrative properties of the task and provide baseline experiments . |
| Outcome: | The proposed task is very challenging and the results are impressive. |
Copied to clipboard
| Challenge: | PTLMs can exhibit biases against protected groups in a host of modeling tasks . but, fine-tuned LMs may propagate bias to downstream classifiers . |
| Approach: | They propose to use upstream bias mitigation techniques to reduce bias on downstream tasks by fine-tuning an upstream model and applying it to a downstream model. |
| Outcome: | The proposed model reduces bias on hate speech detection, toxicity detection and coreference resolution tasks over bias factors. |
Copied to clipboard
| Challenge: | Existing approaches to detect gendered language require considerable annotation efforts for each language, domain, and author, and often require handcrafted lexicons and features. |
| Approach: | They use existing NLP pipelines to automatically annotate gender of mentions in the text and train a supervised classifier to predict the gender of any mention from its context and evaluate it on unseen text. |
| Outcome: | The proposed method can detect gendered language on movie summaries, movie reviews, news articles, and fiction novels. |
Copied to clipboard
| Challenge: | Existing work on style transfer has focused on controlling formality, authorial style, and sentiment of text. |
| Approach: | They propose a style transfer task that reframes a dialogue from informal first person to formal third person rephrasing . they use a dataset to annotate dialogues from a text summarization corpus . |
| Outcome: | The proposed task improves the performance of extractive models on a dialogue summarization dataset. |
Copied to clipboard
| Challenge: | Existing models for cross-document coreference resolution have been used for within-document entity coreference but have been relatively limited. |
| Approach: | They propose a model that extends the efficient sequential prediction paradigm for coreference resolution to cross-document settings and achieves competitive results for both entity and event coreference. |
| Outcome: | The proposed model achieves competitive results for entity and event coreference while minimizing error propagation in complex reasoning tasks. |
Copied to clipboard
| Challenge: | Existing methods for coreference resolution exploit the number and gender of antecedents or have been handcrafted and do not reflect the diversity of naturally occurring text. |
| Approach: | They propose a trick to improve resolution by antecedent switching to target common-sense understanding and world knowledge. |
| Outcome: | The proposed method achieves state-of-the-art results on the GAP coreference task. |
Copied to clipboard
| Challenge: | Existing work on document-level relation extraction has focused on end-to-end setting that extracts global entities and relations jointly. |
| Approach: | They propose to introduce a two-way interaction between COREF and RE that is specifically designed to leverage task characteristics, bridging decisions of two tasks for direct task interference. |
| Outcome: | The proposed model achieves the best performance by up to 2.3/5.1 F1 over the baseline. |
Copied to clipboard
| Challenge: | Existing methods to evaluate maximum spans tangle coreference evaluation with mention boundary detection . however, this method is costly and does not scale to large corpora. |
| Approach: | They propose an algorithm for automatically extracting minimum spans to benefit from minimum span evaluation in all corpora. |
| Outcome: | The proposed algorithm is consistent with those manually annotated by experts. |
Copied to clipboard
| Challenge: | Academic neural models for coreference resolution (coref) are typically trained on OntoNotes and model improvements are benchmarked on that dataset. |
| Approach: | They aim to quantify transferability of coref models based on the number of annotated documents available in the target dataset. |
| Outcome: | The proposed model improvements are consistent with the state-of-the-art results on PreCo. |
Copied to clipboard
| Challenge: | Unsupervised pretraining has recently pushed the state of the art on many natural language understanding tasks. |
| Approach: | They perform a large-scale survey on a pretrained RoBERTa model with 110 intermediate-target task combinations and 25 probing tasks to reveal the specific skills that drive transfer. |
| Outcome: | The proposed model is trained on 110 intermediate-target task combinations and compared with 25 probing tasks to reveal the specific skills that drive transfer. |
Copied to clipboard
| Challenge: | Existing approaches to zero-shot learning are format-agnostic and can address new learning tasks without additional training. |
| Approach: | They propose a new paradigm for zero-shot learning that is format agnostic and compatible with any format and applicable to a list of language tasks. |
| Outcome: | The proposed model shows state-of-the-art performance on several benchmarks and produces satisfactory results on tasks such as text classification and commonsense reasoning. |
Copied to clipboard
| Challenge: | Neural coreference resolution models trained on one dataset may not transfer to new, low-resource domains. |
| Approach: | They investigate how to actively label coreference by sampling a small subset of data for annotators to label. |
| Outcome: | The proposed model can be more realistic when labeling spans within the same document than when annotating spans across documents. |
Copied to clipboard
| Challenge: | Recent advances in standardization for annotated language resources have led to successful large scale efforts, such as the Universal Dependencies (UD) project for multilingual syntactically annotized data. |
| Approach: | They propose a multilingual collection of corpora and a standardized format for coreference resolution compatible with morphosyntactic annotations in the UD framework. |
| Outcome: | The proposed framework is compatible with morphosyntactic annotations and includes facilities for related tasks such as named entity recognition. |
Copied to clipboard
| Challenge: | incorporating textual and multimodal reference resolution improves performance in visual-based reference resolution . Phrase grounding is a well-established task for understanding semantic relations between mentions and objects . ambiguities caused by pronouns and ellipses can arise in visually grounded dialogues . |
| Approach: | They propose a framework that unifies textual and multimodal reference resolution by mapping mention embeddings to object embeddements and selecting mentions or objects based on their similarity. |
| Outcome: | The proposed framework performs better in phrase grounding than other models for this task. |
Copied to clipboard
| Challenge: | low-level tasks are used to extract character networks from literary texts, but no study has been conducted on their impact on performance. |
| Approach: | They focus on the role of named entity recognition (NER) and coreference resolution when extracting co-occurrence networks. |
| Outcome: | The proposed methods outperform traditional pipelines in terms of recall and recall. |
Copied to clipboard
| Challenge: | Recent BERT-based models have reported dramatic gains on multiple semantic benchmarks including question-answering, natural language inference, and named entity recognition. |
| Approach: | They apply BERT to coreference resolution, achieving a new state of the art on the GAP and OntoNotes benchmarks. |
| Outcome: | A qualitative analysis of model predictions shows that BERT-large is better at distinguishing between related but distinct entities, but there is room for improvement in modeling document-level context, conversations, and mention paraphrasing. |
Copied to clipboard
| Challenge: | Recent results show that annotating mentions is twice as fast as annotation of full coreference chains. |
| Approach: | They propose a method for efficiently adapting coreference models using only mentions in the target domain without increasing annotator time. |
| Outcome: | The proposed method improves average F1 without increasing annotator time. |
Copied to clipboard
| Challenge: | Recent coreference resolution models rely heavily on span representations to find coreference links between word spans. |
| Approach: | They propose to consider coreference links between individual words rather than word spans and reconstruct the word span. |
| Outcome: | The proposed model outperforms existing models on the OntoNotes benchmark while being highly efficient. |
Copied to clipboard
| Challenge: | Currently, we are adding a new document-level discourse annotation to our new corpus. |
| Approach: | They propose to build a Persian discourse treebank and a comprehensive Persian coreference corpus based on discourse analysis and coreference resolution. |
| Outcome: | The proposed corpus includes 30000 individual sentences with morphological, syntactic and semantic labels and nearly half a million tokens. |
Copied to clipboard
| Challenge: | a corpus of 4M tokens is available online with a large number of high-quality annotation layers. |
| Approach: | They propose to use a genre-balanced English web corpus with multiple annotation layers . they harness knowledge from multiple annotation layer to achieve a "better than NLP" benchmark . |
| Outcome: | The proposed corpus is genre-balanced and features high-quality automatic annotation layers. |
Copied to clipboard
| Challenge: | Movie screenplays have a distinct narrative structure. |
| Approach: | They develop a method to extract structural information and character coreference clusters from movie screenplays by leveraging a movie parser and a character coreferser. |
| Outcome: | The proposed methods scale to long movie screenplays without dramatically increasing their memory footprints. |
Copied to clipboard
| Challenge: | Existing work on aspect-based sentiment analysis (ABSA) focuses on sentence level, document level ABSA is more practical and requires holistic document-level understanding capabilities. |
| Approach: | They propose a learning framework to jointly model the DTSA task and the coreference resolution task using ChatGPT. |
| Outcome: | The proposed framework reduces the reliance on annotated coreference information and alleviates evaluation bias caused by missing coreference targets. |
Copied to clipboard
| Challenge: | Winograd schemas are well-established tools for evaluating coreference resolution and commonsense reasoning capabilities of computational models. |
| Approach: | They present a dataset of German, French, and Russian schemas aligned with their English counterparts. |
| Outcome: | The proposed model improves in English and German, while the model improve in other languages. |
Copied to clipboard
| Challenge: | a semi-supervised approach is used to resolve multimodal coreferences and narrative grounding in a multimodal context. |
| Approach: | They propose a semi-supervised approach that utilizes image-narration pairs to resolve coreferences and narrative grounding in a multimodal context. |
| Outcome: | The proposed approach outperforms baselines quantitatively and qualitatively for coreference resolution and narrative grounding in a multimodal context. |
Copied to clipboard
| Challenge: | Adapted coreference resolution models have only marginally improved performance over representation learning. |
| Approach: | They implement an end-to-end coreference system and four HOI approaches to analyze the impact of higher-order inference on coreference resolution. |
| Outcome: | The proposed model shows that the impact of higher-order inference (HOI) on coreference resolution is negative to marginal, providing a new perspective on the task. |
Copied to clipboard
| Challenge: | Existing methods to improve coreference resolution use labeled data. |
| Approach: | They propose two self-supervised tasks that are closely related to coreference resolution to improve mention representation. |
| Outcome: | The proposed models improve mention representations by learning them on a GAP dataset. |
Copied to clipboard
| Challenge: | Existing work on coreference resolution suggests task-specific models are necessary . a recent line of work that take an alternative approach leveraging advances in seq2seq-based models is needed . |
| Approach: | They propose a pretrained seq2seq transformer to map an input document to a tagged sequence encoding the coreference annotation. |
| Outcome: | The proposed model outperforms or matches the best coreference systems on an array of datasets. |
Copied to clipboard
| Challenge: | Existing datasets for cross-sentence linking are small, resulting in a lack of a model for argument linking. |
| Approach: | They propose a document-level model for finding argument spans that fill an event’s roles by combining semantic role labeling and coreference resolution. |
| Outcome: | The proposed model is able to connect arguments in sentence-level role labeling and coreference resolution on 9,124 annotated events across 139 types. |
Copied to clipboard
| Challenge: | integrating coreference and decomposition increases recall on rare relations by over 20%. |
| Approach: | They propose an open-source pipeline for extracting sentence-level knowledge graphs by combining robust coreference resolution with syntactic sentence decomposition. |
| Outcome: | The proposed pipeline achieves a 99.8% exact-match accuracy on sentence simplification. |
Copied to clipboard
| Challenge: | a new ontology is based on coreference resolution, but it is not comprehensive . a recent study found that ontologies categorize concepts into groups and arrange them in a hierarchy . |
| Approach: | They derive coreference chains from a corpus of 30 million biomedical abstracts and construct a graph based on the string phrases within these chains. |
| Outcome: | The proposed ontology overlaps significantly with human-authored ontologies. |
Copied to clipboard
| Challenge: | Existing commonsense models that generate event-centric inferences for simple sentences struggle with the complexity of multi-event sentences prevalent in natural text. |
| Approach: | They propose a commonsense model that generates inferences for a target event within a complex sentence using a multi-event inference dataset. |
| Outcome: | The proposed model produces inferences for a target event within a complex sentence taking the complete context into account. |
Copied to clipboard
| Challenge: | Large Language Models have shown promising results in coreference resolution, but they face a critical issue: hallucinations. |
| Approach: | They propose a low-hallucination and efficient solution to the problem of hallucinations . they propose efficient constrained decoding for coreference resolution . |
| Outcome: | The proposed approach achieves better performance on the English OntoNotes development set. |
Copied to clipboard
| Challenge: | Existing coreference resolution models for South Asian languages are limited . a a sanity check for the prediction of translations is required to ensure accuracy of the model, authors say . |
| Approach: | They evaluate an end-to-end coreference resolution model on a Hindi golden set . they use translation and word-alignment tools to translate a translated dataset into 31 languages . |
| Outcome: | The proposed model scored 64 and 68 on a Hindi golden set. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) excel in coreference resolution tasks, but previous studies only assessed performance with nouns and third person pronouns. |
| Approach: | They evaluate LLMs' performance on coreference resolution with indexicals like I, you, here and tomorrow which come with unique challenges due to their linguistic properties. |
| Outcome: | The proposed models perform well with some indexicals while struggling with others. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are intended to reflect human linguistic competencies . but when context is absent or insufficient, ambiguity resolution becomes more tenuous . |
| Approach: | They propose a CORRECT-DETECT trade-off between large language models and ambiguity detection . they show that large language model models can achieve good performance with minimal prompting . |
| Outcome: | The proposed models can achieve good performance with minimal prompting in coreference disambiguation and detection of ambiguity in corefertility tasks, but they cannot do both at the same time. |
Copied to clipboard
| Challenge: | Existing evaluation methods for coreference resolution are limited by semantic and contextual information. |
| Approach: | They propose a semantically-enhanced evaluation framework for coreference resolution that assigns semantic labels to nominal mentions and propagates them to entire coreference clusters. |
| Outcome: | The proposed framework uncovers systematic weaknesses obscured by standard metrics. |